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(54) PICTURE TRANSMITTER 

(57)Abstract: 

PURPOSE: To prevent a picture from being deteriorated 
at the time of changing a picture transmission rate. 
CONSTITUTION: A picture transfer rate calculating 
circuit 50 calculates a transfer rate allocated to picture 
transmission. In the case of changing the picture transfer 
rate, an overall INTRA control circuit 52 instructs an 
image encoding circuit 22 to encode all blocks in the 
fixed number of frames by an intra-frame encoding 
system. Consequently the fixed number of frames after 
changing the picture transfer rate are encoded by intra- 
frame encoding and transmitted. 
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*- NOTICES * 

JPO.and NCIPI arc not response b]<5 for any 
damages cnused by tho U5)c of th\.(t tranfll.atlon. 

1; This document has been translated by computer. So the translation may not 
reflect the original precisely. 

2, **** shows the word which can not be translated. 

3. Ih the drawings, any words are not translated. 



CLAIMS. 



[Claim (s)] 

[Claim 1] The image sending .set carry out becoming from the coding means which is 
the image sending set which carries out compression transmission of the image 
information with the coding method which has coding in a screen, and coding 
between screens, and carries out compression coding of the image information 
which should transmit, the transmission rate detection means detect modification 
of a picture transmission rate, and the control means which make the coding means 
concerned encode the screen of the predetermined number after transmission rate 
modification according to the detection result of the transmission rate detection 
meaiis concerned by the coding method encode the whole screen in a screen as the 
description. 

[Claim 2] The image se.nding set according to claim 1 said whose predetermined 
number is plurality. 



[Translation done. ] 
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* NOTICES * 

JPO and NCIPI are not responsible for any 
damaees caused by tho uee of thla translHtion. 

1. This document has been translated by computGr. So the translation may not 
reflect the original precisely. 

2. **** shows the word which can not be translated. 

3. In the drawings, any word.s are not translated. 



DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Industrial Application] More specifically, this invention relates to the imafje 
sending set in picture transmission systems, such as a TV phone and a television 
conference, about an image sending set. 
[0002] 

[Description of the Prior Art] by the spread of digital public communication 
channel networks (the so-called ISDN), an image, voice, and data are 
instantaneous — — it becomes possible and a TV phone and a video 
conference system are becoming realistic. The service convention for voice image 
service using a digital circuit, protocol specification, and a multimedia 
multiplexing frame structure convention are announced as advice H. 320 of the 
Consulting- Committee of International Telegraph & Telephone (CCITT), H. 242 and 
H. 221 grade. ' 

[0003] H.320 specifies the whole system aspect of voice image service. H. 221 
. specifies the coding a.ssignment of FAS (Frame Alignment Signal) and BAS (Bit-rate 
Allocation Signal) in voice image transmission on a 64Kbps - 1,920Kbps channel 
used for a frame structure list by exchange of clearance capacity, assignment of 
the communicate mode, etc. H. 242 specifics the protocol of the capacity exchange 
between the terminals by BAS, and a comrcunicate mode change. 
[0004] After being synchronous established [ which is depended FAS ] by the in 
channel, the approach procedures, such as an exchange sequence of the clearance 
capacity by BAS and a mode change sequence by assignment of the communicate mode, 
perform the compound information communication link of an image, voice, data, 
etc. between terminals by the in channel is prescribed to setting out of the'' 
physical connection of end to end, and a list by the above-mentioned advice 
again. 

[0005] or [ in addition, / that which communicate mode is used for each terminal 
withm the limits of the capacity to have embraced the situation, to be able to 
change or choose self clearance capacity now in the predetermined range, and it 
to have been exchanged ] ~ a convention ~ being out of range . 
[0006] About the transmission speed of each information in the case of 
transmitting an image, voice, and data simultaneously, voice is determined by the 
coding method of a voice sign, data are set as an assignment value and the 
remaining transmission capacity in the transmission speed of a communication line 
is assigned to an image. 

[0007] As a compression method of image information, while raising 
compressibility, the coding method which mokes coding in a frame and motion 
compensation interframe coding intermingled is proposed so that propagation of a 
trahsmission error can be suppressed few. 

[OO'OS: The digital public network is already put in practical use as ISDN. The ' 
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interfaces with which the user is provided are a basic interface (2B (64Kbps) +D 
(16Kbps)) and a primary group interface (HO (384Kbps), HI (1.5Mbps), and 23 B+D). 
A basic interface is replaced with a current analog public network. D channel 
which is an out band channel is used for call connection with a partner terminal, 
and B channel is used for transmission of information data, such as voice, an 
image, and data. Since there are two B channels, the data transfer (bulk 
transfer) of 128Kbps becomes possible by the highest by taking the 
synchronization for these two channels. Since the data transmission capacity of a 
large quantity is needed by TV telephone, the bulk transfer is dramatically 
effective. 
[0009] 

[Problem(s) to be Solved by the Invention] At TV telephone or a television 
conference, mutual control information is multiplexed and transmitted to an 
image, voice, and a data list if needed. Therefore, when there is modification of 
the information to transmit and its coding approach, a multiplexing configuration 
will be changed each time. 

[0010] Since modification of a transmission rate is transmitted to an accepting 
station by the Inn channel-control command of B channel, it is dramatically 
difficult for it to take the synchronization with transmission information. If 
the multiplexing modification stage of a transmit terminal ajid the multiplexing 
modification stage of an accepting station cross, a decode error will occur with 
an accepting station. 

Coon] especially in the case of image data, it explained previously — as — one 
screen ~ the block of a certain arbitration ~ dividing — the block of every — 
the" difference of a before frame ~ with the interframe coding (INTER) which 
encodes and transmits a value Since coding (INTRA) in a frame encoded within one 
frame is used together, even if it can take frame synchronization once frame 
synchronization is confused, by the receiving side, a subject-copy image cannot 
be restored until it receives the new coding screen in a frame to all the above- 
mentioned blocks. That is. when there was modification of a picture transmission 
rate, in a receiving side, there was a fault of taking most time amount before 
carrying out the repeat display of the normal image. 
[0012] This invention aims at showing the image sending set which such 
inconvenience does not produce.' 
[0013] 

[Means for Solving the Problem] The coding means which the image sending set 
concerning this invention is an image sending set which carries out compression 
transmission of the image information with the coding method which has coding in 
a screen, and coding between screens, and carries out compression coding of the 
image information which should transmit, It is characterized by consisting of a 
transmission rate detection means to detect modification of a picture 
transmission rate, and a control means which makes the screen of the 
predetermined number after transmission rate modification encode according to the 
detection result of the transmission rate detection means concerned by the coding 
method which encodes the whole screen in a screen for the coding means concerned. 

[oou; 

[Function] With the above-mentioned means, if there is modification of a picture 
trarismission rate', the screen of a predetermined number will compress the whole 
screen by the coding method encoded in a screen, and it is transmitted. Thereby, 
a receivinjr-side terminal can decode and display a receiving image immediately 
after modification of a picture transmission rate, without referring to a before 
screen. Even if turbulence of the image accompanying modification of a picture 
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^^r^' ^^-^ it generate, by this, it recovers in a 

[0015. 

^»i„g, the ime, display dovic, »Uh ,McJ IS^il ^"'f « a 

display, «o,. and 18 are inage I/O circuit, lliTA "l'^^' " '^^^'^1 
cameras 0 and ,14 as transmission, cwjy ojt 

li^se signal. Here, the image cSw netZJ « """^"i ""J^l- 

of the imwe data to the inLe of the fr™e .Lff"' ""J."'"""'' =""Pression 
transform (OCT), vector Quantization anrfTJ, ^ "^'"^ 

coding and a list by piece drop^Sr iLt irX\T'''",V?2; 
-h„d^^.h can he transmitted .y^6.KJS^es,= l^V^^tZl l^^^^^ls^ 

2^:1 Z v^lV^f^pSJjS:^ j^L^jf ^;f,-lcrophone and a loudspeaker, and 

?r - ^ ' 

vole, input/output of rhand e^ zr » " ™* only switches the 

performs generation Procet n V L L ' uTL" ' ^"^ 

busy tone, and a ringer tone in Jh7 f ^^^^ ^ingi^R tone, a 

[OP20:- The voice coSing ne wor^ whLh T^'f^^^'^ ^^'"'^'^^'^ ^n6 a list. 
trans.it frp. .he voL^S i t^^:^^^^^^^^ ZT^r^' '''''' '' ^^^^^ 

circuits which decrypt the received codini .^n J • ''^'"^ decryption 

S^li ?fL^'rktrL!r"f~^^^ 

operating devices which inpi^wilu direc? on^ ntn t j''^'' "'^""^^ 
42. for exflfliple. it consists of ooin^ini ! . ^y"®" ''^'"^^ol circuit 

P^nel. a digitizer, and a mouse. ^ equip„,ents. such as a keyboard, a touch 

St)\nt48V"i;: lult'^e^inj Jhe'^^rr^^" ^^"^ ^^^N 
control circuit 42 o H 2 I tSe" ^"f^^-^^jf^" fro. the systen, 

frpn, the image coding network 22 rhi vM.' T''^" "^''^ ^^^"^^ t-^«nsmit 
interface .40 and supplyinHhe circuit '"^'^^^J^f"^^^ ^'^^ the data 
nniltiplexing circuit wh ch seDaraL" 1 ? ""^^^ separation 
from the receipt info^lL suppl ed^r^th; ^ control signal 

supplied to^ the image decryptirj '00^ 24 th. L'-' i"'"""^""' ^""^ 

on. cLnerBl oTtJ h'L'L'^U^^^'cS^lr^^^^^ ^^^-^ 
side, and communications c^Jrol ci^cuiriL Lt'' ^"^ of .another 

ontroi circuit 46c that controls a. communication link 
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through D channel. 

l!«ncLl!Tr''i''r'-''^^^"'' "^^^"i^ ^2 possesses the image 

transfer rate calculation circuit 60 which computes the tran.sfer rate essi^rned to 

Z':,tTe\lZt 'I' T^:' '''''''' ^^^^ coSiSlnTS 

the who e block of one frame. The detail of an operation of the image tran.sfer 

rate^calculation circuit 50 and all the INTRA control circuits 52 i" mentioned 

[0026] The flow of the picture signal, in the example shown in drawinfiLl and a 
sound signal IS explained briefly. The input image with a camera Toi.^ the 
paintings-and-calligraphic-works camera 14 is chosen by the image I/O circuit 18 
and IS impressed to the image coding network 22. The image coding network 22 
encodes an input picture signal in the coding mode in which a control signal and 
internal decision are followed from the system control circuit 42, and outputs it 
to the separation multiplexing circuit 48. 

[0027] On the other hand, the input sound signal with the microphone or 
microphone 28 of a hand set 26 is inputted into the voice coding network 34 
through the voice-input/output interface 32. and it encodes here and it is 
inputted into the separation multiplexing circuit 48. 

[0028] Data to transmit from a data terminal. 38 are inputted into the separation 
multiplexing Gircuit 48 through the data interface 40. Moreover, tho data 
inputted from the manual operating device 44 to transmit are also inputted into 
J^non^'^T!:^^"" multiplexing circuit 48 through the data interface 40. 
L0029J The separation multiplexing circuit 48 multiplexes the control command 
from the system control circuit 42 in the coded signal from the image coding 
network 22 and the voice coding network 34, the data from the data interface 40 
and. a list, and outputs it to the circuit interface 46. The circuit interface 46 
outputs .the signal from the separation multiplexing circuit 48 to the 
comnunication line to connect in a predetermined format. 
[QQ30] The signal received from tho communication line is supplied to the 
separation multiplexing circuit 48 from the circuit interface 46. The sep3.ration 
multiplexing circuit 48 separates a coded-image signal, a coding sound signal 
data, and control command from an input signal, and inputs them into the image 
decryption circuit 24. the voice decryption circuit 36, the data interface 40. 
and the system control circuit 42, respectively. 

[0031] The image decryption circuit 24 decodes the coded-image signal from the 
separation multiplexing circuit 48, and inputs it into the image I/O circuit 18 
The image I/O circuit 18 carries out selection composition, and inputs the image 
f^pm cameras 10 and 14, and the receiving image from the image decryption circuit 
24 into an mage display device 16. The image I/O circuit' 18 performs for 
exatnple. a picture Inn picture, fitting to the response window in a window 
display system, etc. as synthetic processing. Thereby, an input image and/or a 
receiving image are displayed on the screen of an image display device 16. 
[0032] The .receiving sound signal decoded by the voice coding network 36 is 
impressed to the loudspeaker and/or loudspeaker 30 of a hand set 26 through the 
voice-mput/output interface 32. Thereby, the voice from a communications partner 
can be heard. 

[0033] The received data separated in the separation multiplexing circuit 48 are 
inputted into a data terminal 38 from the data interface 40. 
[0034] By H. 261 advice, in order to enable the communication link between the 
specification of plurality, such as NTSC system, a PAL sv.«?tem, and a digital 
television signal, the common video format is specified. They are a CIF 'format 

■ f ooo '^^^ ^^^^^^ ^^^^ °^ ^ ^^^'^^ is 176 pixel xI44 line in 352 

pixel x288 line and color-difference signals Cr and Cb at a luminance signal Y 
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QCIF formats are one fourth of the amount of information of a CIF format, and 
sample size is 88 pixel x72 line In 176 pixel xl44 line and colored! fference 
.signals Cr and Cb at a luminance signal Y. 

[0035] The image in a frame is classified into the block of 8 pixel x8 pixel as a 
component engineering of the compression approach. Coding in a frame which 
carries out a 2-dimensional discrete cosine transform (DCT .conversion) to the 
block, The intcrframe coding which takes inter-frame difference and carries out 
2-dimensional DCT conversion to the block of the homotopic of a before frame and 
the present frame, The motion compensation which reduces the amount of generating 
signs by compensating a motion of an inter-frame image, The zero run length 
coding using generally a zero value continuing in a RF field with a DCT transform 
coefficient, The quantization which changes quantization w<Jtep sT7-e according to 
the' yield of data, Variable length coding which assigns a sign value long to a 
data pattern with low occurrence frequency to a data pattern with high occurrence 
frequency for a short sign value, And piece dropping [ which skips a frame ] is 
adopted, high compressibility is attained in such combination, and video 
transmission in the channel of a low rate is made possible. 

[0036] Since interframe coding (INTER) mode can attain high compressibility when 
inter-frame correlation is high, when inter-frame has the coi-relation more than 
fixed, INTER mode is used for it, and the coding (INTRA) mode in a frame is used 
for it at the time of under fixed correlation. 

[0037] Since the quantization error which is a difference between quantization of 
a transmitting side and quantization of a receiving side is accumulated at a 
receiving-side terminal in INTER mode, and this becomes remarkable when 
quantization is coarse, usually INTRA mode is arranged periodically. Also in 
ord^r to prevont propagation of a transmission error, INTRA mode is periodically 
arranged per [ above-mentioned ] block. Especially, like at the time of 
initiation of pictorial communication, it restricts, when there is no reference 
ima(ge for difference'; or when it is a scene change (condition judged that there . 
is no* inter-frame correlation on the whole screen because a scene switches), and 
the whole block in a frame is encoded in a frame. This is called all INTRA 
processings. By all INTRA processings, a decryption error and a quantization 
error are canceled and a screen can be refreshed. 

[0038] Next, the negotiation and the approach of modification of clearance 
capacity are explained to an example for an ISDN circuit. In an ISDN circuit, as 
shown in drawinp: 2 , call origination is carried out using an out band signal 
(that is. D channel). As shown in drawing 2 , the communication link by B channel 
is attained by the call setup .from Terminal A to Terminal B, and the response to 
the terminal A from Terminal B. Although there are D channel, other HO, other HI, 
etc.* as a channel, only B channel explains. 

[0039] Thus, using B channel whose communication link was attained, according to 
advice H.242. as shown in d rawing 3 , an in band signaling procedure is performed 
by B channel, and this assigns the inside of B channel to data division and the 
control, section .which controls a communication link. The control by the control 
section of -an in channel is called the Inn channel control. A control bit is 
needed in B channel for INN channel control, and the frame structure is 
prescribed by advice H. 221. 

[004O] The frame structure in B channel for performing Inn channel control is 
Shawn in drawing^ . Drawing,.4 shows the multi-framing structure over B channel 
(64Kbps). As this multi-^framing structure is shown in drawjjig_4 (a) on the basis 
of one octet / 125 microseconds, one frame shows 80 octets' and (b) and 1 
submuiti -framing shows two frames and ** (c), 1 multi-framing turns into 8 
submulti-framing, Eight subchannel #1-S8 of 8Kbps are defined in the direction of 
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a bit. 

[0041] However, a transfer rate is set to 6. 4Kbps (es) and, only as for subchannel 
sat, the signal of FAS (Frame Aligninent Signal) and BAS (Bit-rate Allocation 
Signal) is inserted as a control bit. By this FAS and BAS, the Inn phannel 
control of B channel becomes possible. 

[0042] In addition, it is used for an FAS frame and a multi-framing 
synchronisation, BAS is used for exchange or capacity setting out of the 
information on clearance capacity required to determine the multiplex approaches, 
such as a subchannel. Even if especially BAS is during data communication, it can 
be switched to every submulti-framing (20ms). 

[0043] The in band signaling procedure shown in dr awing 3 is explained briefly. 
If 3 channel will be in the condition which can be communicated, both the 
terminals A and B will transmit FAS. The clearance capacity at this time is the 
mode 0 (voice and mode of only FAS and BAS) of an initial state, this — FAS — 

— a partner — a terminal ~ searching — having ~ H . — 242 — specifying 
—having had — frame synchronization — establishment — conditions — filling 
— having — if — drawing.^. — being shown — FAS — inside — a bit pattern — 
A "7 * ~ zero ~ ^ — carrying out — transmitting . It is checked that the 
partner terminal has established frame synchronization because a terminal 
receives A- 0, 

[0044] Next, the capacity information in the end of a local is transmitted to a 
partner terminal by BAS, and the capacity of a partner terminal is checked 
mutually. At this event, if a communication link is mutually possible, the 
communication link of data will be started. When capacity change overtime is 
required, after it transmits clearance capacity as a command using BAS similarly 
and a partner terminal completes setting out of the capacity, the communication 
link of data is started. 

[0045] Transmission and reception get down ifrom the communication link of data 
independently, and setting out of clearance capacity is also independently 
performed also for establishment of a synchi'onization. Therefore, a 
synchronization may separate only from a uni directional or the classes of data 
may 'differ by transmission and reception. 

[0046] When the communication link of data is completed and a call is cut, the 
terminal ( drawing 4 the terminal A) of the side to cut makes it the mode 0 first 
uisirig BAS. Thereby, the Inn channel control of B channel returns to an initial 
state. Next, as shown' in drawing 2 , in the out band procedure of D channel, 
cutting and release are performed and all communication links are completed, 
[0047] DrawtnH 5 shows the bit pattern in FAS. Bit A shows the existence of a 
frame synchronization blank, and shows E bits of existence of generating of a CRC 
error. CI, C2, C3, and C4 are the bits of CRC4- As for N1-N5, the object for 
numbering of multi-framing, and R1-R4 are channel numbers. TEA is a terminal unit 
alarm, and when an input signal cannot be answered by failure inside a terminal, 
it is set to "1." 

[0048] Drawing 6 shows the bit pattern in BAS. As shown in .drawing_6 R> 6 (a), a 
high order triplet expresses an attribute and remaining 5 bits of attribute value 
of the attribute are shown, ^wingj^ (b) shows the content of the attribute. 
There is parameter value peculiar to for example, a transfer rate value, codec 
classification, each medi?\, or information etc. in attribute value. 
[0Q49] Drawing 7 , d rawing 8 , drawing 9 , drawin g 1,0 , and drawing 11 show the 
flow chart of characteristic actuation of this example as a whole. Here, the 
transfer rate which secured' X to the information transmission, the transfer rate 
which deducted the transfer rate which secured Y to the voice data transfer from 
the. transfer rate X, the transfer rate to which Z deducted the transfer rate of 
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41), Zp will be updated by Z (S42) and coding processing of the image information 
will usually be carried out after this at a passage (S43). the case where there 
is no modification in an imaffe transfer irate — (S39) — coding processing of the 
image information is usually carried out at a passage (S43). It progresses to S46 
after S43, 

[0058] When there is no image Request to Send by the operator (S36), the image 
coding section is stopped (44 S 45). 

[0059] If modification of capacity is notified to a partner terminal (S47) and 
the content of modification has the addition of B channel when there is no image 
capacity in a partner terminal (S35), and there is a change request of transfer 
capacity from an operator (S46) (S53), connection of B channel will be added 
(S54), if there is a cutback of B channels (S55), connection of B channel will be 
reduced (S56) and S14 or subsequent ones will be repeated henceforth. 
[0060] There is a disconnect request (S48), and if it is a thing from a partner 
terminal (S49)-, according to advice of transition, it will change in the mode 0 
to the mode 0 by the HAS command from a partner terminal in which only voice is 
treated (S50). Moreover, if a disconnect request is a thinp; from the end of a 
local (S49), the BAS command will notify the transition to the mode 0 to a 
partner terminal, and the end of a local will be made into the mode 0 CS51). S — 
cutting processing of a circuit is performed by the D channel control after 50 
and 51 (S52). 

[0061] Especially a receiving-side terminal does not need to be conscious of the 
ab6ve--m€ntioned actuation of a transraitting-side terminal, and does not need to ' 
add a specific function to a receiving-s;ide terminal, 

[0062] At this'example, even if turbulence of an image stops arising and it is 
generated by S39-42 also at the time of modification, of an image transfer rate, 
it will restore in a **** short time, 
[0063 j 

[Effect of the Invention] According to this invention, even if there is 
modification of a picture transmission rate, turbulence of a transmission image 
can be controlled substantially and a transmission image is restored at an early 
stage, so that he can understand easily from the above explanation. Moreover, 
since a transmitting-side terminal is only controlled by advice within the 
limits, there is an advantage that it can communicate with all the accepting 
stations based on advice. 
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* NOTICES * 

JPO find MCIPI are not responsible for any 
damages caused by th« use of this translation. 

l.This document has been translated by computer. So the translation may not 

reflect the original precisely. 

2-**** shows the word which can not be translated. 

3. In the drawings, any words are not translated. 



TECHNICAL FIELD 



[Industrial Application] More specifically, this invention relates to the image 
sending set in picture transmission systemuS, such as a TV phone and a television 
conference, about an image sending set. 
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* NOTICES * 

JPO and NCIPI ftro not respoaslblc for any 
damases cau«cd by the use of* this translation, 

1. This documeat has been translated by computer. So the translation may not 
reflect the original precisely. 

2. **** shows the word which can not bo translated. 
3. In the drawings, any words are not translated. 



' DESCRIPTION OF DRAWINGS 
[Brief Description of the Drawings] 

[Dra wing 11 It is outline configuration block drawing of one example of this 
invention. 

[Dr awing 2] It is drawing showing the procedure of cutting from setting out of a 
call. 

[Dr awjnp; 3] It is drawing showing the Inn channel^control procedure. 
[Drawin g ^1 H. It is the explanatory view of the frame structure of 221. 
[Drawing 5] It is FAS bit pattern drawing. 
[Drawing 6j It is bit pattern drawing of BAS. 
Inlaying. 7j. It is a part of operation flow chart of this example. 
[Drawing 8l It is a part of operation flow chart of this example. 
[Drawing 9] It is a part of operation flow chart of this example. 
iDrawin g 10] It is a part of operation flow chart of this example. 
. [Drawing 11] It is a part of operation flow chert of this example. 
[Description of Notations] 

10: Camera- 14: Paintings-and-calligraphic-works camera 16: Image display device 
18: Image. I/O circuit 

22: image coding-network 38: data-terminal 40: ~ data interface 42 — : system 
control circuit 44:manual operating device 46:circuit interface 46a and a 46 
brgate circuit [ ] — 46 c: communications control circuit 48 — :separation 
multiplexing circuit 50: image transfer rate calculation circuit 52: — a total — 
an INTRA control circuit A 24: images decryption circuit 26: ~ a hand set 28: ~ 
a microphone 30: — a loudspeaker A 32: voice-input/output interface 34:voice 
coding network 36: voice decryption circuit 
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* NOTICES * 

JPO «nd NCIPI arc not responalbl.e for any 
damages cau3e<i by the une of this trflnalation . 



1. This document has been translated by computer. So the translation may not 
reflect the original precisely. 

2. **** shows the word which can not be translated. 

3. In the drawings, any words are not translated. 



EXAMPLE 



[Example] Hereafter, the example of this invention is explained with reference to 
a drawing. 

[0016] DrawingJ. shows outline configuration block drawing of the terminal unit 
in one example of this invention. 

[0017] In drawing,..! . the camera with which 10 photos a board participant the 
paintings-8Hd-calUgraphic-works camera with which 14 photos records, such as a 
• drawing, the image display device with which 16 consists of CRT, a liquid crystal 
. display, etc... and 18 are image I/O circuits which choose the output ^mage of 
cameras 10 and 14 as transmission, carry out selection composition of the output 
image and receiving image of cameras 10 and 14. and are supplied to an image 
display device 16. 

[0018] The image coding network which encodes the picture signal which 22 should 
transmit, and 24 are image decryption circuits which decrypt the received coded- 
image signal. Here, the image coding network 22 carries out the band compression 
of the image data to the inside of the frame which uses a discrete cosine 
transform (DCT), vector quantization, and a motion compensation, and between 
coding and. a list by piece dropping. There is CCITT advice H. 261 as a coding 
method which can be transmitted by 64Kbps (es) of the basic interface of an ISDN 
circuit. 

[0019] The hand set with which 26 consists of a microphone and a loudspeaker, and 
28 are the voice-mput/output interfaces to as opposed to [ as opposed to / in a 
microphone and 30 / a loudspeaker ] a hand set 26, a microphone 28, and s 
loudspeaker 30 in 32. The voice-input/output interface 32 not only switches the 
voiQe input/output of a hand set 26, a microphone 28. and a loudspeaker 30 ' but 
performs generation processing of tones, such as a dial tone, ringing tone! a 
rnSn^^T!' * "T' ^" cancellation processing and a list. 

LOO^OJ The voice coding network which encodes the sound signal which 34 should 
transmit from the voice-input/output interface 32, and 36 are voice decryption 
c:trcuits which decrypt the received coding sound signal and are outputted to the 
''l'T^t''^''^^''''Jr^ interface 32. There arc PCU (A-law) of 64Kbps. PCM (micro-law) 
?p.o? puL \ ^^^'"■'^ (SB-ADPCM), ADPCM of 32Kbps. 16Kbps (for example. LD- 
rnno 1 J'^'''^^^^^^' 1" transmission speed and the coding approach. 
LUO^IJ It IS a data interface for 38 to connect Data Terminal Equipments, such as 
l^nM^i^'rl ^^'"P"^^^' 40 connect Data Terminal Equipment 38 concerned. 

LO0Z2J The system control circuit where 42 controls the whole, and 44 are manual 
operating devices which input various directions into the system control circuit 
lor example, it consists of pointing equipments, such as a keyboard, a touch 
panelj^ a digitizer, and a mouse. 

[0023] 46 the circuit interface of a communication line (for example, ISDN 
circOit) and 48 ffhile multiplexing the control information from the system 
control circuit 42 to H.221 format at the information list which should transmit 
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from the image coding network 22, the voice coding network 34, and the data 
interface 40 aiid .supplying the circuit interface 46 It is the separation 
multiplexing circuit which separates an image, voice, data, and a control signal 
from the receipt information supplied from the circuit interface 46, and iss 
supplied to the Image decryption circuit 24, the voice decryption circuit 36, the 
•data interface 40, and the system control circuit 42, respectively. 
[0024] In this example, the circuit interface 46 possesses gate circuit 46a for 
one channel Bl of two B channels, gate circuit 46b for channel B*-2 of another 
side, and communications control circuit 46c that controls a communication link 
through D channel. 

[0025] Moreover, especially the system control circuit 42 possesses the image 
transfer rate calculation circuit 50 which computes the transfer rate assigned to 
image data, and all the INTRA control circuits 52 that force coding in a frame of 
the whole block of one frame. The detail of an operation of the image trajisfer 
rate calculation circuit 50 and all the INTRA control circuits 52 is mentioned 
latei", 

[00261 The flow of the picture signal in the example shown in drawin R 1 and a 
sound signal is explained briefly. The input image with a camera 10 and the 
paintings-and-calligraphic-works camera 14 is chosen by the image I/O circuit 18, 
arid is impressed to the image coding network 22. The image coding network 22 
encodes an input picture signal in the coding mode in which a control signal and 
internal decision are followed from the system control circuit 42, and outputs it 
to the separation multiplexing circuit 48. 

[0027] On the other hand, the input sound signal with the microphone or 
microphone 28 of a hand set 26 is inputted into the voice coding network 34 
through the voice-input/output interface 32, and it encodes here and it is 
.inputted into the- separation multiplexing circuit 48. 

[0028] Data to transmit from a data terminal 38 are inputted into the separation 
multiplexing circuit 48 through the data interface 40. Moreover, the data 
inputted from the manual operating device 44 to transmit are also inputted into 
the separation multiplexing circuit 48 through the data interface 40, 
[0029] The separation multiplexing circuit 48 multiplexes the control command 
from the system control circuit 42 in the coded signal from the image coding 
network 22 and the voice coding network 34, the data from the data interface 40, 
and a list, and outputs it to the circuit interface 46. The circuit interface 46 
outputs the signal from the separation multiplexing circuit 48 to the 
communication line to connect in a predetermined format. 
[0030] The signal received from the communication line is supplied to the 
separation multiplexing circuit 48 from the circuit interface 46. The separation 
multiplexing circuit 48 separates a coded-image signal, a coding sound signal, 
data, and control command from an input signal, and inputs them into the image 
decryption circuit 24, the voice decryption circuit 36. the data interface 40, 
and the system control circuit 42, respectively. 

[0031: The. image decryption circuit 24 decodes the coded-image signal from the 
separation multiplexing circuit 48, and inputs it into the image I/O circuit 18- 
The image 1/0 circuit 18 carries out selection composition, and inputs the image 
from cameras 10 and 14, and the receiving image from the image decryption circuit 
24 into an image display device 16. The image I/O circuit 18 performs for 
example, a picture Inn picture, fitting to the response window in a window 
display system, etc. as synthetic processing. Thereby, an input image and/or a 
receiving image are displayed on the screen of an image display device 16. 
[0032] The receiving sound signal decoded by the voice coding network 36 is 
impressed to the loudspeaker and/or loudspeaker 30 of a hand set 26 through the 



http://www4.ipdl.ncipi.go.ip/cgi-bin/tran^web^cg 



2005/3/22 



* P,0T-023377,A [EXAMPLE] 



voice-^input/output interface 32, Thereby, the voice from a cominuni cat ions partner 
can be heard, 

[0033] The received data .separated in tho separation multiplexing circuit 48 are 
inputted into a data terminal 38 from the data interface 40. 
[0034] By 11.261 advice, in order to enable the communication link between the 
specification of plurality, such as NTSC system, a PAL system, and a digital 
television signal, the common video format is specified. They are a CIF format 
and a QCIF format. The sample size of a CIF format is 176 pixel xl44 line in 352 
pixel x288 line and color-difference signals Cr and Cb at a luminanGe signal Y. 
QCIF formats are one fourth of the amount of information of a CIF format, and 
sample size is 88 pixel x72 line in 176 pixel xl44 line and color-difference 
signals Or and Cb at a luminance signal Y. 

[0035] The image in a frame is classified into the block of 8 pixel x8 pixel as a 
component engineering of the compression approach. Coding in a frame which 
carries out a 2-dimensional discrete cosine transform (OCT conversion) to the 
blockj The interframe coding which takes inter-frame difference and carries out 
2-diracnsional DCT conversion to the block of the homotopic of a before frame and 
the present frame, The motion compensation which reduces the amount of generating 
signs by compensating a motion of an inter-^freme image, The 2ero run length 
coding using generally a zero value continuing in a RF field with a DCT transform 
coefficient, The quantization which changes quantization step sixe according to 
the yield of data, Variable length coding which assigns a sign value long to a 
data pattern with low occurrence frequency to a data pattern with high occurrence 
frequency for a short sign value, And piece dropping [ which skips a frame ] is 
adopted, high compressibility is attained in such combination, and video 
transmission in the channel of a low rate is made possible. 

[0036] Since interframe coding (INTER) mode can attain high compressibility when 
inter-frame correlation is high, when inter-frame has the correlation more than 
fixed,' IN*FER mode is used for it, and tho coding (INTRA) mode in a frame is used 
for it at the time of under fixed correlation. 

[0037] Since the quantization error which is a difference between quantir.ation of 
a transmitting side and quantization of a receiving side is accumulated at a 
receiving-side terminal in INTER mode, and this becomes remarkable when 
quantization is coarse, usually INTRA mode is arranged periodically. Also in 
order to prevent propagation of a transmission error, INTRA mode is periodically 
arranged per [ above-mentioned ] block. Especially, like at the time of 
initiation of pictorial communication, it restricts, when there is no reference 
image for difference, or when it is a scene change (condition judged that there 
is no intcr^frame correlation on the whole screen because a scene switches), and 
the whole block in a frame is encoded in a frame. This is called all INTRA 
processings. By all INTRA processings, a decryption error and a quantization 
error are canceled and a screen can be refreshed. 

[0038] Next, the negotiation and the approach of modification of clearance 
.capacity are explained to an example for an ISDN circuit. In an ISDN circuit, as 
shown in drawing 2 , call origination is carried out using an out band signal 
(that is, D channel)- As shown in drawing 2 , the communication link by B channel 
is attained by the call setup from Terminal A to Terminal B, and the response to 
the terminal A from Terminal B. Although there are D channel, other HO, other HI, 
etc- as a channel, only B channel explains. 

[0039.] Thus, using B channel whose communication link was attained, according to 
advice H.'242, ixs shown in drawing 3 , an in band signaling procedure is performed 
by B channel, and this assigns the inside of B channel to data division and the 
control section which controls a communication link. The control by the control 
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section of an in channel is called the Inn channel control. A control bit is 
needed in B channel for INN channel control, and the frame structure is 
prescribed by advice H. 221. 

[0040] The frame structure in B channel for performing Inn channel control is 
shown in drawing/l . Drawing 4 shows the multi-framing structure over B channel 
(64Kbps). As this multi-framing structure is shown in drawing 4 (a) on the basis 
of one octet / 125 microseconds, one frame shows 80 octets and ^* (b) and 1 
submulti-framing shows two frames and (c), 1 multi-framing turns into. 8 
subfflulti-framing, Eight subchannel *tl-#8 of 8Kbps are defined in the direction of 
a bit. 

[0041] However, a transfer rate is set to 6. 4Kbps (es) and, only as for subchannel 
#8, the signal of FAS (Frame Alignment Signal) and BAS (Bit-rate Allocation 
Signal) is inserted as a control bit. By this FAS and BAS, the Inn channel 
control of B channel becomes possible. 

[0042] In addition, it is used for an FAS ** frame and a multi-framing 
synchroni?:ation, BAS is used for exchange or capacity setting out of the 
information on clearance capacity required to determine the multiplex approaches, 
such as a.subchanneL Even if especially BAS is during data communication, it can 
be switched to every submulti-framing (20ms). 

[0043] The in band signaling procedure shown in drawing 3 is explained briefly. 
If B channel will be in the condition which can be communicated, both the 
terminals A and B will transmit FAS. The clearance capacity at this time is the 
mode 0 (voice and mode of only FAS and BAS) of an initial state, this — FAS — 
** — a partner — a terrninal ~ searching — having — H . ~ 242 ^- specifying 
^ having had — frame synchronization — establishment — conditions — filling 
-^ having — if — drawing 5 ~ being shown ~ FAS ~ inside — a bit pattern — 
A ^- — zero — — carrying out — transmitting . It is checked that the 
partner terminal has established frame synchronization because a terminal 
receives A= 0. 

[0044] Next, the capacity information in the end of a local is transmitted to a 
partner terminal by BAS, and the capacity of a partner terminal is checked 
mutually. At this event, if a communication link is mutually possible, the 
communication link of data will be started. When capacity change overtime is 
required, after it transmits clearance capacity as a command using BAS similarly 
and a partner terminal completes setting out of the capacity, the communication 
link of- data is started. 

[004S] Transmission and reception. get down from the communication link of data 
independently, and setting out of clearance capacity is also independently 
performed also for establishment of a synchronization. Therefore, a 
synchronization may separate only from a uni directional or the classes of data 
m&y differ by transmission and reception. 

[0046] ffhen the communication link of data is completed and a call is cut, the 
terminal ( drawi ng 4 the terminal A) of the side to cut makes it the mode 0 first 
using BAS. Thereby, the Inn channel control of B channel returns to an initial 
state. Next, as shown in drawing 2 , in the out band procedure of D channel, 
cutting and release are performed and all communication links are completed. 
[0047] Drawing 5 shows the bit pattern in FAS. Bit A shows the existence of a 
frame synchronization blank, and shows E bits of existence of generating of a CRC 
error. CI, C2, 'C3, and C4 are the bits of CRC4- As for N1-N5, the object for 
numbering of multi-framing, and R1-R4 .arc channel numbers. TEA is a terminal unit 
alarm, and when an input signal cannot be answered by failure inside a terminal, 
it is set to ''I. 

[0048] Drawing 6 shows the bit pattern in BAS. As shown in drawio.gJi 6 (a), a 
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high order triplet expresses an attribute and remaining 5 bits of attribute value 
of the attribute are shown. Brawj^ng 6 (b) shows the content of the attribute. 
There is parameter value peculiar to for example, a transfer rate value, codec 
classification, each media, or information otc. in attribute value. 
[0049] Drawinf^t 7 . drawing 8 , drawing.._9 , drawing 10 , and drawing 1 1 show the 
flow chart of characteristic actuation of this example as a whole. Here, the 
transfer rate which secured X to the information transmission, the transfer rate 
which deducted the transfer rate which secured Y to the voice data transfer from 
the transfer rate X, the transfer rate to which Z deducted the transfer rate of 
data (LSD, HSD) from the transfer rate Y, and Zp are the transfer rates Z before 
transmitting capacity change overtime. 

[0050] First, as communication link initiation processing, Zp is initialized by 
X, y, Z, andO, and the frame number of all the INTRA frames (frame which encoded 
the whole block in the frame) transmitted at the time of modification of 
transmitting. capacity etc. is set up (SI). 

10051] It investigates whether it is a compound information terminal treating an 
image, voice, end data (S2), and if it is not a compound information terminal, it 
will investigate whether it is the audio usual telephone (S3). In the 
communicatipn link as a telephone (S3), it connects with a partner terminal by 
the call' control in D channel, and (S4) and B channel are connected (S5). The 
voice section is made into activation status (S6), and a circuit is maintained to 
cutting actuation (S7)- Cutting actuation cuts (S7) and a circuit (S8). In 
addition, -when there is also no telephone (S3), other terminal treatment is 
performed (S9). 

[0052] In the case of a compound information terminal (S2), it connects with a 
partner terminal by the call control in D channel (SIO), end B channel is 
connected (Sll). The Inn channel control of B channel is started (812), and an 
FAS synchroni^:ation is detected (S13). If an FAS synchronization is established 
(S13). the capacity of a partner terminal will be checked by the negotiation, of 
the capacity by HAS (S14). 

[0053] If voice capacity is in a partner terminal (S15), the voice section will 
be- started according to the voice Request to Send by the operator (S16) (17 S 
18). The transfer rate A of voice data is subtracted from the transfer rate X of 
secured B channel (S19). and it investigates whether it is possible whether Y 
which it is as a result of subtraction is forward, and an. image, i.e., data, to 
transmit (820). If Y is not forward (820), data division iand the image coding 
section will be stopped (S21), and it will progress to S49. If Y is forward 
(520), the existence of the data capacity of a partner terminal will be 
distinguished (S25). 

[0054] When there is no voice capacity in a partner terminal (S15), or when there 
is no voice Request to Send by the operator (S16), the voice section is stopped 
(22 S 23) and X Is substituted for Y (S24). That is, the transfer rate X of 
secured B channel is assigned to an image and data transfers. Then, the existence 
of the data capacity of a partner terminal is distinguished (S25). . 
ip055] If data capacity is in a partner terminal (S25), data division will be 
started according to the data Request to Send by the operator (S26) (27 8 25). 
TJie data transfer rate B is subtracted from the transfer rate Y which can be used 

(529) , and it investigates whether it is possible to transmit whether Z which.it 
is as a result. of subtraction is forward, and an image (S30). If Z is not forward 

(530) , the image coding section will be stopped (S31) and it will progress" to 
S49. If Z is forward (S30), the existence of the image capacity of a partner 
terminal will be distinguished (S35). 

[0056] When there is no data capacity in a partner terminal (S25), or when theire 
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is no data Request to Send by the operator (S26), data division are stopped (32 S 
33) and Y is subsiituted for Z (S34), That is, the transfer rate Y which can be 
used is assigned to an image transfer. Then, the existence of the image capacity 
of a partner terminal is distinguished (S35). 

[0057] If image capacity is in a partner terminal (S35), the image coding section 
will be started according to the image Request to Send by the operator (S36) (37 
S'38)* If it investigates whether an image transfer rate has modification by the 
comparison of Z and Zp (S39) and there is Z!"Zp, i.e., modification, (S39), 
convention frame number transmi.5s.ion of all the INTRA frames is carried out (40 S 
41), Zp will be updated by Z (S42) and coding processing of the. image information 
will usually be carried out after this at a passage (S43). the case where there 
is no modification in an image transfer rate — (S39) — coding, processing of the 
image information is usually carried out at a passage (S43), It progresses to S46 
after S43. 

[0058] When there is no image Request to Send by the operator (S36), the image 
coding section is stopped (44 S 45). 

[0059] If modification of capacity is notified to a partner terminal (S47) and 
the content of modification has the addition of B channel when there is no image 
capacity in a partner terminal (S35), and there is a change request. of transfer 
capacity from an operator (S46) (S53), connection of B channel will be added 
(S54), if there is a cutback of B channels (S55), connection of B channel will be 
reduced (S56) and S14 or subsequent ones will be repeated henceforth, 
{0060] There is a disconnect request ($48), and if it is a thing from a partner 
terminal (S49), according to advice of transition, it will change in the mode 0 
to the mode 0 by the BAS command from a partner terminal in which only voice is 
treated (S50). Moreover, if a disconnect request is a thing from the end of a 
local (S49), the BAS command will notify the transition to the mode 0 to a 
partner terminal, and the end of a local will be made into the mode 0 (S51). S — 
cutting processing of a circuit is performed by the D channel control after 50 
and 51 (S52). 

[0061] Especially a receiving-side terminal does not need to be conscious of the 
above-mentioned actuation of a transmitting^side terminal, and does not need to 
add a specific function to a receiving*side terminal. 

[0062] At this example, even if turbulence of an image stops arising .and it is 
generated by S39-42 also at the time of modification of an image transfer rate» 
it will restore in a H«Me* short time. 
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OPERATION 



[Function] With the above-mentioned means, if there is modification of a picture 
transmission rate, the screen of a predetermined number will compress the whole 
screen by the coding method encoded in a .^screen, and it is transmitted. Thereby 
a receiving-side terminal can decode and display a receiving imago immediately' 
after modification of a picture transmission rate, without referring . to a before 
screen. Even if turbulence of the image accompanying modification of a picture 
transmission rate stops almost arising and it generates by this, it recovers in a 
**** short time. 
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MEANS 



[Means for SolvinR the Problem] The coding means which the image sending set 
concerning this invention is an image sending set which carries out compression 
transmission of the image information with the coding method which has coding in 
a screen, and coding between screens, and carries out compression coding of the 
image information which should transmit, It is characterized by consisting of a 
transmission rate detection means to detect modification of a picture 
transmission rate, and a control means which makes the screen of the . 
predetermined number after transmission rate modification encode according to the 
detection result of the transmission rate detection means concerned by the coding 
raetbod which encodes the whole screen in a screen for the coding means concerned." 
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TECHNICAL PROBLEM 



[Problem(s) to be Solved by the Invention] At TV telephone or a television 
conference, mutual control information is multiplexed and transmitted to an 
image voice, and a data list if needed. Therefore, when there is modification of 
the information to transmit and its coding approach, a multiplexing configuration 
will be changed each time. iBui<inun 

[0010] Since modification of a transmission rate is transmitted to an accepting 
f channel-control command of B channel, it is draraaticaJly 

ditficult for it to take the synchronization with transmission information. If 
the multiplexing modification stage of a transmit terminal and the multiplexing^ 
modification stage of an accepting station cross, a decode error will occur with 
an accepting station. 

[0.011] especially in the case of image data, it explained previously - as - one 
fu'^^^^r •'I'^ck.of a certain arbitration - dividing -- the block of every - 
the difference of a before frame - with the interframe coding (INTER) which 
encodes and transmit.s a value Since coding (INTRA) in a frame encoded within one 
frame is used together, even if it can take frame synchronization once frame 
synchronizationis confused, by the receiving side, a subject-copy image cannot 
bo restored until it receives the new coding screen in a frajno to all the above- 
mentioned blocks. That is. when there was modification of a picture transmission 
rate, in a receiving side, there was a fault of taking most time amount before 
carrying out the repeat display of the normal image. 
[0012] This invention aims at showing the image sending set which such 
inconvenience does not produce. 
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EFFECT OF THE INVENTION 



[Effect of the Invention] According to this invention, even if there i<i 
modification of a picture transmission rate, turbulence of a transmission image 
can be controlled sub.<!tantiaUy and a transmission imaRe is restored at an early 
stage, so that he can understand easily from the above explanation. Moreover 
since a transmitting-side terminal is only controlled by advice within the 
limits, there is an advantage that it can communicate with all the accepting 
stations based on advice. 
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PRIOR ART 



[Description of the Praor Art] by the spread of digital public communication 
channel networks (the so-called ISDN), an image, voice, and data are 
instantaneous - **** ~ it becomes possible and a TV phone and a video 
conference system are becoming realistic. The service convention for voice ima?e 
service u.sing a digital circuit, protocol specification, and a multimedia 
multiplexing frame structure convention are announced as advice H.320 of the 
Consulting Committee of International Telegraph & Telephone (CCITT), H.242. and 
H. 221 grade. 

[0003] H. 320 specifies the whole system aspect of voice image service H 221 
specifies the coding assignment of FAS (Frame Alignment Signal) and BAS (Bit-rate 
Allocation Signal) in voice image transmission on a 64Kbps - 1, 920Kbps channel 
used for a frame structure list by exchange of clearance capacity, assignment of 
the communicate mode, etc. H. 242 specifies the protocol of the capacity exchange 
between the terminals by BAS, and a communicate mode change. 
10004] After being synchronous established [ which is depended FAS ] by the in 
channel, the approach procedures, such as an exchange sequence of the clearance 
capacity-by BAS -and a mode change sequence by assignment of the communicate mode, 
perform the compound information communication link of an image, voice, data, 
etc. between terminals by the in channel is prescribed to setting out of the' 
physical connection of end to end, and a list by the above-mentioned advice 
again. 

[0005] or L in additipn, / that which communicate mode is used for each terminal 
within the limits of the capacity to have embraced the situation, to be able to 
change or choose self clearance capacity now in the predetermined range, and it 
to have been exchanged ] ~ a convention -- being out of range . 
[0006] About the transmission speed of each information in the case of 
transmitting an image, voice, and data simultaneously, voice is determined by the 
ceding method of a voice sign, data are set as an assignment value and the 
remaining transmission capacity in the transmission speed of a communication line 
is assigned to an image. 

[0007] As a compression method of image information, while raising 
compressibility, the coding method which makes coding in a frame and motion 
compensation Ihterframe coding intermingled is proposed .so that propagation of a 
transmission error can be suppressed few. 

[0008] The digital public network is already put in practical use as ISDN. The ' 
interfaces with which the user is provided are a basic interface (2B (64Kbps) +D 
(16Kbps)) and a primary group interface (HO (384Kbps), HI (1.5Mbps), and 23 B+D). 
A 'basic inteirface i.s replaced with a current analog public network. D channel 
which is an out band channel is used for call connection with a partner terminal, 
arid B channel is used for transmission of information data, such as voice, an 
image, and data. Since there are two B channels, the data transfer (bulk 
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trwsfcr) of 128Kbps beconies possible by the highest by taking thp 

H^^^nS'f- these two channels. Since the data transmission capacity of a 

effective ^ telephone, the bulk transfer is dramatically 
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